Feedback Control Using Only Quantum Back-Action 
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The traditional approach to feedback control is to apply forces to a system by modifying the 
Hamiltonian. Here we show that quantum systems can be controlled without any Hamiltonian 
feedback, purely by exploiting the random quantum back-action of a continuous weak measurement. 
We demonstrate that, quite remarkably, the quantum back-action of such an adaptive measurement 
is just as effective at controlling quantum systems as traditional feedback. 
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In optical systems, continuous quantum measurements 
now have the precision to realize quantum feedback con- 
trol [1-3], and measurements in nano-electro-mechanical 
systems are rapidly approaching this regime [4-7]. We 
expect the ability to perform real-time measurement and 
feedback in nano-systems is will open up a fertile field of 
applications for quantum control (see, e.g. [8-11]). 

Feedback control is traditionally realized by applying 
forces to a system (that is, modifying the Hamiltonian) 
in response to information obtained. This procedure is 
used even if the information is not realized in a measure- 
ment [12], but is passed directly to a second quantum 
system for processing, as in "coherent" feedback [13-15]. 
This paradigm comes to us from classical feedback con- 
trol. It has also been shown that measurements alone can 
be used to control a system by "dragging" it using the 
"quantum anti-Zeno" effect [16-18]. However, for this 
to be effective the rate at which the measurements act 
must be much greater than the time-scale of the dynam- 
ics of the controlled system. Such a regime is unlikely 
to be practical for most applications of continuous-time 
feedback control. 

Here we show that in quantum systems, one can im- 
plement feedback control without applying forces via 
a Hamiltonian, but merely by continually adjusting a 
continuous quantum measurement made on the system. 
The mechanism for this is not the anti-Zeno effect, but 
the (random) quantum back-action of the measurement. 
This mechanism is much more powerful than the anti- 
Zeno effect, since it induces dynamics on the time-scale 
of the measurement itself. 

Controlling quantum systems using measurement 
back-action is made possible by two things. The first 
is that a gradient in diffusion acts similarly, although not 
identically, to a deterministic force. The second is that 
quantum systems can be measured in different bases. As 
we will see below, it is this that allows us to exploit dif- 
fusion gradients to realize control. That a diffusion gra- 
dient induces deterministic motion can be seen from the 
following simple one-dimensional Fokker-Planck equation 
for the probability density of a variable x, 
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FIG. 1: A diagram depicting the control protocol. The target 
state is |0), at the top of the Bloch sphere. The black dashed 
line is the Bloch vector of the current state. The grey dashed 
line gives the direction of the measured spin, and the grey 
solid line gives the direction of the induced diffusion on the 
Bloch sphere. 



Here the first term describes deterministic motion of x at 
the rate x = v, and the second term describes diffusion at 
the rate D(x). The quantity J is the probability current, 
in general a function of x and time t. Calculating J we 
find that 
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So we see that the gradient of the diffusion rate, dD/dx, 
generates a term in the probability current equivalent to 
a negative deterministic velocity. 

We can realize a diffusion gradient by making a contin- 
uous measurement which is continuously modified using 
a feedback process (in other words, making an adaptive 
measurement). This technique is most easily understood 
by considering the control of a single qubit. To begin 
with, let us assume that the qubit is in an arbitrary state 
pure, and we wish to rotate it to a given "target" state 
\tjj). We choose our coordinate axes so that \if>) is the 
a z spin-up eigenstate. We will call the spin-up state |0) 
and the orthogonal state |1). An arbitrary pure state is 
|x) = cos(0)|O) +sin(0)e^|l), where S = 2\6\ gives the 
distance to the target state on the Bloch sphere. Since 
we have rotiational symmetry, we can set <f> = with- 
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FIG. 2: Performance of quantum control with adaptive mea- 
surement according to two measures: (a) The average error 
probability, (P e ), as a function of time, when the system starts 
with P = 1. The average is taken over many noise realiza- 
tions. The dashed line is the asymptotic slope, (b) The aver- 
age time to reach a target value of P e . The dashed line is the 
asymptotic slope. 

out loss of generality, so that the state lies in the xz- 
plane: \6) = \x) = cos(0)|O) +sin(0)|l). We now make a 
continuous measurement of spin, in the direction in the 
xz-plane that is perpendicular to the Bloch vector (see 
Fig. 1). This generates the maximum rate of diffusion 
on the surface of the Bloch sphere, and keeps the state 
in the xz-planc. The equation of motion of the density 
matrix, pg = \6)(6\, under this measurement is [19, 20] 

dpe = —k(9)[ae,[cre,po]dt 

+ ^2k(0){agpg + Pe&e - 2(cre)pe)dW, (3) 

where the spin component being measured is 

og = cos(26>)cr. T - sin(26>)cr z , (4) 

and dW is the Wiener noise increment satisfying dW 2 = 
dt [20] . Note that this measurement is continually deter- 
mined by a feedback process, because the measured ob- 
servable, and the measurement strength, k, depend on 6: 
it is an adaptive measurement. With this measurement, 
the evolution equation for the distance to the target, 8, 
is dS = \J 8k(9)dW . We can now obtain a diffusion gra- 
dient for 8 simply by making the measurement strength 
a function of 8. We choose k = kS 2 , and this results in 
the following linear stochastic equation for 8: 

dS = VfteSdW. (5) 

The diffusion rate for 8, as defined using the Fokker- 
Planck equation above, is now D(8) = 8k8 2 . 

The first questions we want to answer are 1. how fast 
this adaptive measurement moves the state to the target, 
and 2. how accurately it pins the state to the target once 
it has arrived. We consider two physically well-motivated 
ways to quantify the answers. The first is to calculate the 



evolution of the average probability that the system is not 
in the target state (the "error" probability), (P e ) = ((1 — 
cos(<5))/2). Here the average is taken over all realizations 
of the noise. When the system is close to the target 
state (P e < 1), this becomes (P e ) « (8 2 )/4 = (6 2 ). To 
simulate the evolution we note that 8 is a cyclic variable, 
so we must solve Eq.(5) on the interval [0, n] with periodic 
boundary conditions. This has no analytic solution, so 
we solve it numerically. Choosing the initial state to be 
maximally distant from the target (<5(0) = ir), we plot the 
evolution of (P e ) in Fig. 2. From this plot we see that 
after an initial transient, the average error probability 
decays asymptotically as a simple exponential. The rate 
of this decay is 1.23k. The adaptive measurement thus 
moves the system to the target on the timescale of the 
measurement, 1/k. There is also no upper bound to the 
precision with which the measurement can pin the system 
to the target - as time goes by (8 2 ) and P e decrease 
without limit. 

A second well-motivated measure of the speed of the 
control protocol is the average time it takes for the con- 
trol to bring the system within a given distance of the 
target state [21]. Once again, a sensible measure of this 
distance is the error probability P c . In Fig. 3 we plot this 
average time as a function of P e , once again starting the 
system furthest from the target. This shows very similar 
behavior to that of (P e ): the "target" error probability, 
P e , drops asymptotically as an exponential function of 
the average time to reach it. In this case the decay rate 
is 1.05k. 

So far we have evaluated the performance of our 
"diffusion-gradient" control algorithm in the absence of 
noise. We now consider controlling a qubit in the pres- 
ence of dephasing noise and spontaneous decay, these 
being the most common noise sources for this system. 
These noise sources are described by the master equa- 
tion 

P = Xl&fa' \- a iiP\\ +7(2o-_/w-+ - {<T + a-,p}), (6) 

j=x,y,z 

where o± = (1/2) (o^ ± icr y ), and {•,•} is the anti- 
comutator. The parameters $ give the respective rates 
of dephasing in the three orthogonal directions, and 2j 
is the rate of decay from the target state |0) to the state 
|l) which is orthogonal to it. The presence of noise mixes 
the state, reducing the length of the Bloch vector. Be- 
cause of this our control protocol now needs to purify the 
system (lengthen the Bloch vector) to counter the effect 
of the noise, in addition to rotating the system to the 
target. Fortunately these two tasks are compatible. 

We will denote the length of the Bloch vector by a, 
and use the quantity A = l — a to quantify how mixed 
the state is. We note that the control protocol we have 
used so far already purifies the system, and in fact does 
so deterministically [22]. For small A, the evolution of 
the length of the Bloch vector is A = — 8k A = —8kS 2 A. 
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However, since 5 — > as we approach the target state, we 
do need to add something else to our protocol to maintain 
the purity when the system is close to the target. We can 
do this without interfering with the dynamics of <5 by 
adding a measurement along the direction of the Bloch 
vector. This measurement lengthens the Bloch vector 
by inducing a diffusion gradient for A. The equations 
of motion for the system, when we add this additional 
measurement, and including the noise, are 



dS = V8^{S/a)dW 
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-2-fCsdt - 0(7 + 4f3 x + Af3 y )dt 
-0(7 + 4& - 4f3 z )C 5 dt, 

where Cg = cos(<$), Ss = sin(<5), fi is the strength of the 
measurement parallel with the Bloch vector, and dV is 
the Wiener noise of the second measurement. This is 
uncorrelated with dW, so that the noises satisfy the Ito 
calculus relation dWdV = 0. 

We can expect this new protocol to act on the same 
time-scale as the previous protocol, since it exploits the 
same control mechanism for both 5 and A. What is of 
most interest now is the steady-state that the protocol 
achieves in the presence of the noise. We want to know 
whether we can achieve effective control, and if so, how 
strong the measurement strengths k and /1 must be to 
accomplish this. Realizing good control in the steady- 
state means that the steady-state average error probabil- 
ity, (-P| s ), is much less than unity. In this regime, we have 
(Pf) = ((1 -acos(cQ)/2><« A ss )/2 + (0/4. Since we 
must solve the equations of motion for A and 6 numeri- 
cally, we gain some insight by examining the dynamical 
equations in the regime of "good control" [23] . By "good 
control" we mean the parameter regime in which the con- 
trol protocol can maintains A <§C 1 and S -C 1. 

Expanding Eqs.(7) and (8) to leading-order in 8 and 
A the dynamical equations become 



dS 
dA 



[37- 
4( 7 • 



4(/?x 



-$ z )]5dt + y 

- Py - P z )dt - 



8n5dW (9) 
-2y%lAdV (10) 



We see from these equations that the effect of noise is to 
add deterministic (drift) terms to the dynamics that act 
to increase both 6 and A. From our analysis above we 
know that in the absence of noise both variables tend to 
zero as t — > 00 . While the drift terms for the two variables 
are qualitatively different (that for A is constant, while 
that for S is linear) we will find that both variables now 
reach a non-zero steady-state in the presence of noise. 

We simulate the above control protocol for a range of 
noise strengths. We note that for the purposes of simu- 
lation it is best to convert the variables A and i5 to the 
Bloch vector elements a x and a z , as this gives numeri- 
cally stable equations. For simplicity we set all the four 
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FIG. 3: The steady-state performance of three feedback pro- 
tocols in the presence of dephasing noise and spontaneous de- 
cay. The performance is characterised by the average steady- 
state error probability, {Pq S ). The noise strength is param- 
eterized by 7, and the measurement and feedback strengths 
of all protocols are bounded by a constraint proportional to 
K. (a) The diffusion-gradient protocol, (b) The diffusion- 
gradient protocol (dashed-line) along with two Hamiltonian 
feedback protocols. Dark line: Hamiltonian feedback with a 
perpendicular measurement; Gray line: Hamiltonian feedback 
with a parallel measurement. 



noise strengths to be equal (/3 X = f3 y = /3 Z =7). We 
fix the measurement strength k, set fj, = k, and vary the 
noise strength from 0.005k to 0.5k. The resulting steady- 
state average error probability as a function of the noise 
strength is displayed in Figure 3(a). This shows that the 
protocol realizes good control so long as the measurement 
strength is significantly larger than the noise. 

We now compare the performance of "diffusion- 
gradient" feedback control with that of conventional feed- 
back control, in which a Hamiltonian is used to contin- 
ually move the system towards the target state [12]. In 
fact, the optimal protocol for controlling a qubit using 
Hamiltonian feedback is not presently known, so we will 
compare our new method with two such protocols. In 
both protocols we continually adjust the Hamiltonian so 
that it always rotates the system directly towards the tar- 
get state, as this is likely to be optimal. The form of the 
Hamiltonian is H{t) — ha(t)a n ^ /2. Here a is the rate 
at which the Hamiltonian rotates the system on the Bloch 
sphere (the "feedback strength"), and er n (t) denotes a 
spin operator in the direction of a unit vector n(i). In the 
diffusion gradient protocol the measurement strength /i is 
fixed at k, and k is bounded by k < max(K<5 2 ) = tt 2 k. To 
compare with Hamiltonian feedback, we must therefore 
also bound the feedback strength a. In doing so we em- 
phasize that comparing diffusion-gradient feedback with 
Hamiltonian feedback is an imprecise affair, since it is 
not clear what Hamiltonian "strength" one should equate 
with the measurement strength k. Nevertheless, for the 
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purposes of comparison we set max(a) = max(fc) = kit 2 , 
which seems reasonable. 

We must now select the measurement strategies for our 
two Hamiltonian feedback protocols. For a 3> k, and 
when the ratio a/k is fixed, previous work has shown 
that the optimal protocol is to measure in a basis per- 
pendicular to the Bloch vector [24]. But we do not ex- 
pect this to be optimal for the constraints we have here. 
In view of this we will examine two quite different mea- 
surement strategies. The first involves making a perpen- 
dicular measurement, for which we impose the bound 
k < ktt 2 . It is important to note that for a given noise 
strength and fixed a, this protocol will have an optimal 
value of k. We therefore perform simulations for a range 
of k values, and report the best performance for each 
noise strength. The second strategy involves making a 
parallel measurement. Since the strength of the parallel 
measurement in our diffusion-gradient protocol was fixed 
at /i = k, we use the same measurement strength for this 
"parallel" protocol. 

In Figure 3(b) we plot the performance of the two 
Hamiltonian feedback protocols against that of the 
diffusion-gradient protocol. The performances of all of 
these are remarkably similar, to the surprise of the au- 
thor. Thus according to the metrics we have used, adap- 
tive measurement is just as effective for controlling sys- 
tems as Hamiltonian feedback. 

Diffusion-gradient control can be extended easily to 
systems of any finite dimension N. Consider an TV- 
dimensional system that we wish to keep close to a target 
state \tp). If the current state is |x), then we can apply a 
diffusion gradient to rotate |x) to by measuring the 
appropriate observable, S. If the density matrix for the 
system is mixed, then we equate |x) with the eigenvec- 
tor of the density matrix with the largest eigenvalue. We 
can calculate the required observable £ by considering 
the Bloch sphere of the two-dimcsnional space spanned 
by |x) = |0) and \ip) = cos(0)|O) + sin(0)e-^|l); this 
gives £ = n • <x, with n = (sin(20), - cos(20), 0). The 
purity of the state can be maintained without interfering 
with the diffusion gradient by measuring an observable 
that has |x) as one of its eigenvectors. This is an TV- 
dimensional equivalent of measuring an observable par- 
allel to the Bloch vector. 

The above prescription for controlling an iV-level sys- 
tem does not fully specify the measurements — there is 
much freedom left in the choice of observables. Further, 
in large systems, the choice of available observables will 
usually be restricted. How to optimize diffusion gradi- 
ent control for larger systems, and under precisely what 
restrictions effective control can be achieved, are inter- 



esting questions for future work. 
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